LINEARLY RECONFIGURABLE KALMAN FILTERING FOR A VECTOR PROCESS 
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ABSTRACT 

In this paper, we consider a dynamic linear system in state- 
space form where the observation equation depends linearly 
on a set of parameters. We address the problem of how to dy- 
namically calculate these parameters in order to minimize the 
mean-squared error (MSE) of the state estimate achieved by 
a Kalman filter. We formulate and solve two kinds of prob- 
lems under a quadratic constraint on the observation param- 
eters: minimizing the sum MSE (Min-Sum-MSE) or mini- 
mizing the maximum MSE (Min-Max-MSE). In each case, 
the optimization problem is divided into two sub-problems 
for which optimal solutions can be found: a semidefinite pro- 
gramming (SDP) problem followed by a constrained least- 
squares minimization. A more direct solution is shown to 
exist for the special case of a scalar observation; in particu- 
lar, the Min-Sum-MSE solution can be found directly using a 
generalized eigendecomposition, and is optimally solved uti- 
lizing Rayleigh quotient, and the Min-Max-MSE problem re- 
duces to an SDP feasibility test that can be solved via the 
bisection method. 

Index Terms — Linear dynamic model. Vector Kalman 
filter. Linearly reconfigurable Kalman filter, MSE minimiza- 
tion. 



1. INTRODUCTION 

Dynamic state-space models in which the observation equa- 
tion depends on parameters that can be adaptively tuned to 
improve performance have recently been proposed by several 
authors. For example, in [1], dynamic wireless channel pa- 
rameters such as the delay of arrival, the angle of arrival, the 
angle of departure, etc, are tracked via a Kalman filter whose 
performance depends on properties of the antenna array. In 
Pi, the parameters to be estimated are the position and veloc- 
ity of a target and the observations at a set of mobile sensors 
are the time delay and Doppler shift of the signal reflected by 
the target. The positions of the mobile sensors are adjusted 
in order to minimize the tracking error of a standard extended 
Kalman filter In i3j, a distributed sensor network problem 
is considered where the observed signal is a linear function 



of the transmission gain of each sensor, and optimal values 
for these gains are found under different power constraints to 
minimize the MSE of a scalar variable at the fusion center 

In this paper, we consider a scenario that generalizes the 
one assumed in [ 3 1 by allowing the estimated parameters and 
the observations to be vector- rather than scalar-valued. The 
state-space observation matrix is assumed to depend linearly 
on a set of parameters, and we consider the problem of op- 
timizing these parameters in order to minimize the MSE ob- 
tained by a Kalman filter that tracks the unknown state. Two 
different optimization problems are considered: one that min- 
imizes the sum MSE (Min-Sum-MSE) over all the parame- 
ters, and another that minimizes the maximum MSE (Min- 
Max-MSE) of all parameters. In the general case, we divide 
the overall problem into two sub-problems whose optimal so- 
lution can be found. The first sub-problem estimates the opti- 
mal observation matrix without taking the linear structure into 
account, and the second finds the set of parameters that are 
closest to the resulting observation matrix under a quadratic 
constraint on the parameters themselves. Dividing the prob- 
lem into these two steps will cause a performance loss, but 
simulations demonstrate that the loss is minimal, and perfor- 
mance is close to the lower bound given by the solution to 
the unconstrained problem. We also consider the special case 
of a scalar observation, and show that in this case the Min- 
Sum-MSE problem is converted to a Rayleigh quotient maxi- 
mization problem, for which an optimal closed-form solution 
is obtained, and we show that for the Min-Max-MSE prob- 
lem, a relaxed version of the problem leads to a simple SDP 
feasibility test that can be solved via the bisection algorithm. 
Simulation results show that in most cases, the solution to the 
relaxed and unrelaxed problems are the same. 

2. VECTOR OBSERVATION MODEL 

We assume the dynamic parameter to be estimated is a 
complex-valued vector that obeys the following state-space 
model: 



Br, 



= F0„ 



where On+i € C*'^^ ^ is the parameter at time step n + 1, F G 



••MxM 



is the state transition matrix, and u„ 



(1) 

F e 
CJ\f{0, Q) is 



the process noise. The observed signal vector is given by 

y„ = C0„ + v„ , (2) 

where v„ ~ CAf{0, cr^I) is the observation noise and C e 
X M jg j-jjg observation matrix. We assume that C is a linear 

function of some parameters a G c^vxi ^^^jj jj^^j. vec[C] — 

Ga for a given G G C^^ixn_ 

The MSE of the state estimate is found via the standard 

Kabnan filtering equations H : 

• Prediction MSE Matrix 

M„|„_i =FM„_i|„„iF^ + Q (3) 

• Kalman Gain Matrix 

K„ = M„|„_iC^(a2l + CM„|„_iC^)-i (4) 

• MSE matrix 

M„|„ = (I - K„C)M„|„_i 



' n\n — l —2 



(5) 



2.1. Minimize Sum MSE 



In this section we consider the problem of minimizing the 
sum-MSE under a quadratic constraint of a. The ideal opti- 
mization problem is formulated as 

min tr(M„|„) (6) 

s.t. ||C(a)|||,<P. 

The solution to (|6]l is difficult to obtain directly, so instead we 
divide the optimization problem into two subproblems. We 
first find an unconstrained C* that minimizes tr(M„|„), and 
then based on C*, we obtain the approximate solution a*. 
The first step is to solve 

min tr(M„|„) (7) 



c 
s.t. 



\C\\l<P 



Defining C = C^C, we can rewrite d?) as 
tr(D) 



mm 
c 

s.t. 



(8) 
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M 



-1 

n I n — 1 



tr(C) < P 
C >r . 

Replacing the equality in the first constraint of (|8) with an 
inequaUty yields an equivalent optimization problem: 

tr(D) (9) 



rnm 

C,D 
S.t. 



r< Mr} , + 4tC 



71 \n—l 



tr(C) < P 
C >- . 



The problem in (|9]l is equivalent to (O in the sense that for 
the optimal solution of problem (|9]l the equality of the first 
constraint must hold. According to the Schur complement 
|5 1, the first constraint in (|9]l is equivalent to : 



n[?i— 1 
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Plugging (fTOb into (|9]), we have 
tr(D) 



mm 

CD 



S.t. 



(10) 



(11) 
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tr(C) < P 
C >- . 
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By converting the constraints of problem (fTTt into a large 
block diagonal linear matrix inequality, we can transform the 
problem into a standard SDP form, which can be efficiently 
solved using the interior point method. 

Denote the optimal solution to problem ( fTTT i as C*, and 
define the singular value decomposition of C* as C* ~ 
USU^, so that C* = S^U^. The performance of C* 
provides a lower bound for problem (|6). To estimate a*, we 
solv43 



min ||vec(C*) — Ga||; 

a 

S.t. a^G^Ga^P, 



which directly leads to 

a* =7(G^G)-iG^vec(C* 



(12) 



(13) 



where 7 is defined as 7 



voc(C*)"G(G«G)-iG«vcc(C*) ' 



2.2. Minimize the Maximum MSE 

When the maximum MSE is to be minimized, the parameter 
optimization problem can be stated as 



min max [M„|„]i,i 

a i 

S.t. ||C(a)|||,<P 



(14) 
(15) 



Similar to (|6]l, when treating C as the variable to be opti- 
mized, we can rewrite problem (IT4t as 



mm max 
c i 

S.t. 



[M. 



n\n\i.i 



\c\\%<P 



(16) 



Introducing an auxiliary variable t, we can rewrite ([TtI i as 



min t 
c.t 



(17) 



s.t. 



t > [M„ 



|C|||,<P. 



'At the optimal solution of (6), the constraint should attain equality. 



Define as the vector with all zeros except for a 1 in the ilh 
position, so that ( [TtI i is equivalent to 



mm 

c,t 



t 



(18) 



s.t. t > eTM„ 



|C|||<P 



Again, we utilize the Schur complement to rewrite the first 
constraint in ( fTsT i and we have 



mm 



s.t. 



t Bi 

* n I n — 1 



(19) 



tr(C) < P 
ChO . 

Similar to (fTTT l. we can write the constraints of problem (IT9] 
in a large block diagonal linear matrix inequality and convert 
the problem to a standard SDP form. After obtaining C*, we 
can use (15) to find the solution a*. 

3. SCALAR OBSERVATION MODEL 

For a scalar observation, we have 

yn = c"en+Vn, (20) 

where c = Ga and as before G G C*^^^. The MSB of the 
estimated state is given by 

M„i„ = M„|„_i - . (21) 

3.1. Minimize Sum MSE 

For a scalar observation, the sum MSE is computed as 

tr(M„|„) = tr(M„|„_i) - , (22) 

and we formulate the following optimization problem: 



a^G-f^M^i ,Ga 

I n — 1 

"'a'' a,2+a^GffM„|„_iGa 
s.t. a^G^Ga < P . 



(23) 



Since the objective function in (1231 1 is monotonically increas- 
ing with the norm of c, the constraint must be active at the 
optimal solution and we can rewrite the problem as 



a^G^M,V_iGa 



a^(^GHG + G^M„|„_iG)a 
s.t. a^G^Ga^P. 



(24) 



The solution to the above problem can be found directly as 

(25) 



P 



u^Bu 



B 2u , 



whereB = ^G^G + G^M„|„_iG, and u is the eigenvec- 
tor corresponding to the largest eigenvalue of B~5 G^M^^i^^GB" 

3.2. Minimize the Maximum MSE 

When the maximum MSE is to be minimized, the optimiza- 
tion problem becomes 



minmax [M„|„]i, 

a i 

S.t. a^G^Ga < P 



(26) 



Substituting (|2TI) into ( |26] |. we have 



minmax [M„|„_i]i 



efM„|„_iGaa^G^M„|„_ie, 
a2+affG^M„|„_iGa 



s.t. a^G^Ga < P . 
Introducing the auxiUary variable t, we have 
min t (27) 

a 

efM„|„_iGaa^G^M„|„_ie,; 



s.t. 



[M„|„_ 



a2+affGffM„|„_iGa 



I,--- ,iV 



a^G^Ga < P 



After some mathematical manipulation, we can rewrite prob- 
lem ( l27T i into the following form 



mm 

a 
S.t. 



(28) 



([M„|„_i],,, - t)<jl < a^E.a, i = l,--- ,N 
a^G^Ga < P, 



where E^ is defined as E,; = G^(M„uj^ieief ]V[„|„_i — 
([M„|„_i]i^i — i)M„|„_i)G. Problem ( |28] l is equivalent to 

min t (29) 

a 

S.t. ([M„|„_i],,, -t)(T2 <tr(AE,), i = !,■•■, TV 
tr(AG^G) < P 
rank(A) = 1 
A ^ . 

At this point, we see that the problem could be efficiently 
solved without the rank constraint. Consequently, we relax 
this constraint to yield a quasi-convex problem: 

min t (30) 

a 

S.t. ([M„|„_i],,, - t)al < tr(AE,), z = 1, • • • ,7V 
tr(AG^G) < P 
A >- . 



In the above problem, given a deterministic t, all the con- 
straints are convex. Denote the optimal value of problem (|30] | 
as t*, so that for a t that makes the problem (|30] | feasible, 
we have t* < t, while if the problem is infeasible, we have 
t* > t. To find t*, we search over t using the bisection method 
||6l . For a given t, we solve the SDP feasibility problem: 



find A 

s.t. ([M„|„_i],,, - t)al < tr(AE,; 
tr(AG^G) < P 
A >- 



, i 1, ■ 



(31) 



to obtain the optimal t*, then we plug this t* into problem ( [30] l 
to find A*. If rank(A*) = 1, then A* is the optimal solu- 
tion to problem ( |26] l. otherwise, a rank-one solution a* can 
be reconstructed. The optimal value t* of problem ( [30l l can 
be used as a lower bound for the minimum MSB of problem 
( |26l ). Our simulations indicate that in most cases, the rank 
of A* is one, which indicates the performance of a* is very 
close to the lower bound provided by A*. 
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Fig. 2. Maximum MSE vs. the value of constraint P 



by reducing the number of control parameters from 16 to 3. 
When the P is small, the proposed method can achieve a per- 
formance close to the lower bound, e.g., when P — 0.5, the 
performance degradation in the sum MSE is less than 10%. 
For the scalar observation case, we see as expected that the 
Min-Sum algorithm has the lowest sum-MSE and the Min- 
Max algorithm has the lowest maximum MSE. Surprisingly, 
however, in the vector case the performance of the Min-Sum 
and Min-Max algorithms is essentially identical. The perfor- 
mance of the Min-Max-MSE algorithm appears to be equal 
to the lower bound which indicates that the solution A* to 
problem (|30] | is very likely rank-one even with the constraint 
relaxed. With increasing P, a performance floor exists for the 
scalar-observation case, while in the vector-observation case 
the MSE performance continues to improve. 



5. CONCLUSION 



Fig. 1. Sum MSE vs. the value of constraint P 



4. SIMULATIONS 

In the following simulations, the dimension of dn and a are 
M = 4 and N ~ 'd respectively and L is set to 4. The obser- 
vation noise variance is set to cr^ = 0.5, and the covariance Q 
is assumed to be an identity matrix. The matrix F and the G 
are generated as complex Gaussian matrices with independent 
unit variance elements, and F is scaled to guarantee conver- 
gence of the Kalman filter Once they are generated, F and G 
are kept constant in the simulation. The MSE performance for 
different constraints P are calculated after convergence of the 
Kalman filter In Figs. [T][2l for the vector-observation case 
the lower bound corresponds to the MSE calculated using 
C*. The performance gap between the lower bound and the 
proposed method represents the performance loss introduced 



In this paper, we investigated the problem of a Kalman fil- 
ter with a linearly reconfigurable observation matrix. Two 
kinds of problems were formulated: Min-Sum-MSE or Min- 
Max-MSE. For the vector observation model, both of the op- 
timization problems are difficult to solve directly, and we di- 
vided the problem into two simpler sub-problems that are eas- 
ier to solve. Simulation results show that when the quadratic 
constraint is small, the proposed approach provides perfor- 
mance close to the MSE lower bound. For the scalar obser- 
vation model, the Min-Sum-MSE problem is converted to a 
Rayleigh quotient maximization problem, for which an opti- 
mal closed-form solution is obtained, and for the Min-Max- 
MSE problem, we relax the rank-one constraint on the obser- 
vation parameters and transform the optimization problem to 
an SDP feasibility problem. Based on the solution to the SDP 
feasibility problem, a rank-one solution can be reconstructed. 
Simulation results show that with a very high probability the 
solution of the relaxed problem is indeed rank-one. 
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